• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    systems and processes for tissue imaging. process and system for forming tissue images, including: (i) causing a macroscopic image of a tissue surface to be displayed on a visual monitor; (ii) receiving a selection of at least a portion of the macroscopic image; (iii) causing multiple confocal images, captured by the confocal imager at different depths in a corresponding part of the tissue, to be displayed; (iv) receiving a selection of at least one image of a desired depth; and (v) for each selected desired depth image, instructing the confocal imager to capture multiple additional images at different locations across a selected region of tissue and at a common depth with the desired depth image. a system for forming tissue images having: a macroscopic display module; a first selection module; a confocal display module; a second selection module; and an instruction module for instructing a confocal imager to capture multiple images at different locations across a selected region of tissue.
    公开号:BR112015003464B1
    申请号:R112015003464-0
    申请日:2013-08-09
    公开日:2022-01-18
    发明作者:Paul Hemmer
    申请人:Lucid, Inc；
    IPC主号:
    专利说明:

    MUTUAL REMITTANCE ON RELATED PATENT APPLICATION
    [001]This patent application claims the benefit of priority under 35 USC Ç 119(e) to US Provisional Patent Application Serial No. 61/683,417, filed August 15, 2012, the entirety of which is incorporated by reference in this descriptive report. FIELD OF THE INVENTION
    [002] Embodiments of the present invention relate to a user interface for a confocal microscope, which allows clinicians or others to examine a tissue, at the macroscopic and microscopic levels, and capture images suitable for pathological examination of that tissue. BACKGROUND
    [003]Confocal microscopes optically section tissue to produce sectional microscopic images of tissue, referred to herein as confocal images. An example of a confocal microscope is the VivaScope® confocal microscope, manufactured by Caliber Imagins & Diagnostics, Inc. (fks Lucid, Inc., hereinafter Lucid, Inc.) of Rochester, New York, USA. Other examples of confocal microscopes are described in U.S. Patents 5,788,639, 5,880,880, 7,394,592, 7,859,749, 5,995,867 and 7,864,996, incorporated herein in their entirety. A confocal microscope optically images sections in a non-histologically prepared, naturally or surgically prepared in vivo tissue that are useful for evaluating a tissue lesion without the need for biopsy and pathological evaluation of mechanically sectioned tissue sample slides of this tissue. biopsy. Also, confocal microscopes are useful for pathological examination of tissue ex vivo, that is, tissue removed from a patient, without the need for that tissue to be mechanically sectioned and histologically prepared for viewing on slides with a traditional microscope.
    [004] In particular, US patent 7,864,996 describes a confocal microscope system for forming images of tissue, having a macroscopic imager for capturing a microscopic image, and a confocal imager for capturing one or more microscopic images ( confocal) sectional optically formed on or within tissue, a tissue fixation device, such as a tissue ring, in which the macroscopic imager and the confocal imager are both presented individually to the tissue using the tissue fixation device in a predefined alignment with the device, thereby, the confocal imager's imaging sites, with respect to the tissue surface, spatially correlate with the macroscopic image. A computer system is coupled to the macroscopic imager and the microscopic imager, and has a display, and a memory for storing at least one macroscopic image, received from the macroscopic imager, and confocal images, when received from the imager. confocal. A user interface, operating on the computer system, allows to display the macroscopic image on a display, coupled to the computer system, and then indicates a region within the macroscopic image associated with a field of view of the tissue imageable by the confocal imager. The user interface provides graphical tracking of the confocal imager's imaging site to capture confocal images at one or more selected imaging sites on the macroscopic image. The user interface also allows tagging in the displayed macroscopic image of one or more locations of confocal images, captured by the confocal imager, which have been selected by the user for storage in the computer system's memory. This user interface is typically built into the VivaScope® 1500 confocal microscope. RESUME
    [005]Using the confocal microscope of US patent 7,864,996, a clinician or other trained user operates the confocal microscope by navigating the user interface on the display so as to select individual confocal images at a desired location and at depths in the tissue with respect to a captured microscopic image. To facilitate this confocal image acquisition, the U.S. Patent 7,864,996 system has two automatic confocal imaging modes called VivaStack® and VivaBlock® modes. In VivaStack® mode, a group of confocal images is captured at successive depths in tissue at a common location, relative to the tissue surface of the displayed macroscopic image. In VivaBlock® mode, a group of confocal images is captured and then arranged as a composite image to map a region of tissue to a common depth in the tissue. A manual for a system employing the technology of U.S. Patent 7,864,996, i.e. VivaScan Operations Guide, 2011, Lucid, Inc. is incorporated herein by reference in its entirety. Clinicians using the U.S. Patent 7,864,996 user interface may find it difficult to aim at the desired depth at which to capture an image in VivaBlock® mode; in addition, clinicians may also find it difficult to change capture characteristics in VivaStack® mode, such as the number of sectional layers, depth, or power of confocal images.
    [006] Consequently, embodiments of the present invention provide an improved user interface for a confocal microscope, providing additional functionality and ease of use for clinicians, or other users, in tissue examination, providing a visual process for selecting sites to gather. the images, and providing ease of navigation, for example, by a touch screen or a mouse, through the collected images.
    [007] In one aspect, embodiments of the invention include a process for imaging tissue, the process including causing a macroscopic image of a tissue surface, captured by a macroscopic imager, to be displayed on a visual monitor. A selection of at least a part of the macroscopic image is received. For each selected part of the macroscopic image, several confocal images, captured by a confocal imager at different depths in a corresponding part of tissue, are caused to be displayed on the visual display unit. From among the various confocal images, a selection of at least one image of desired depth is received. For each desired depth image selected, the confocal imager is instructed to capture multiple additional images, at different locations across a selected region of tissue and a common depth with the desired depth image.
    [008]One or more of the following aspects may be included. The visual display unit may include a touch screen. Receiving the selection of at least a portion of the macroscopic image may include identifying at least a touch of at least a portion of the macroscopic image on the touch screen. Receiving the selection of the at least one image of desired depth may include identifying at least one touch of the at least one confocal image displayed on the touch screen. Identification of the selected region of tissue may include identifying at least one touch of the macroscopic image displayed on the touch screen.
    [009]The selected tissue region can correspond to a user adjustable region superimposed on the macroscopic image. A grid can be caused to overlap the macroscopic image, the grid dividing the images into blocks representing frame positions from a scaler engine to the confocal imager.
    [010] Upon receipt of the selection of at least a part of the macroscopic image, a graphic input for the confocal images to be captured can be caused to be displayed on the visual display unit.
    [011]Graphic input can include user-selectable inputs to select a depth of, a layer count for, and a laser power variance with depth for the confocal images to be captured.
    [012]Multiple additional images can be captured individually at different locations by selected tissue region. By at least a depth common to a selected desired depth image, a composite image of the selected region of tissue, from the additional images captured individually, can be formed. The composite image can be triggered to be displayed on the visual display unit.
    [013] In another aspect, embodiments of the invention include a system for tissue imaging. The system includes a computer memory for storing images captured by macroscopic and confocal imagers and for storing a code defining an instruction set, and a processor for executing the instruction set. The code includes an imager module configured to: (i) cause a macroscopic image of a tissue surface, captured by the macroscopic imager, to be displayed on a visual monitor; (ii) receiving a selection of at least a portion of the macroscopic image; (iii) for each selected part of the macroscopic image, causing multiple confocal images, captured by the confocal imager at different depths in a corresponding part of tissue, to be displayed on the visual display unit; (iv) receiving a selection from among the various confocal images of at least one image of a desired depth; and (v) for each selected desired depth image, instructing the confocal imager to capture multiple additional images at different locations across a selected region of tissue and at a common depth with the desired depth image.
    [014]One or more of the following aspects may be included. The visual display unit may include a touch screen. The image forming module, upon receiving the selection of at least a part of the macroscopic image, can be configured to identify at least one touch of at least a part of the macroscopic image, displayed on the touch screen, and/or identify at least one touch of at least one confocal image displayed on the touch screen. The image forming module can be further configured to identify the selected region of tissue by identifying at least one touch of the macroscopic image displayed on the touch screen.
    [015]The selected tissue region can correspond to a user adjustable region superimposed on the macroscopic image.
    [016]The imager module can be configured to cause a grid to be superimposed on the macroscopic image, the grid dividing the macroscopic image into blocks representing frame positions from a scaler engine to the confocal imager.
    [017]The image forming module can be configured to cause, after receiving the selection of at least a part of the macroscopic image, a graphic input for the confocal images, which will be captured to be displayed on the visual display unit. Graphical input can include user-selectable inputs to select a depth of, a layer count for, and a laser power variance with depth for the confocal images to be captured.
    [018]Multiple additional images can be captured individually at different locations by selected tissue region. The image forming module may be configured to form, for at least a depth common to a selected desired depth image, a composite image of the selected region of tissue from the individually captured additional images. The image forming module can be further configured to cause the composite image to be displayed on the visual display unit.
    [019] In yet another aspect, embodiments of the invention include a system for tissue imaging. The system includes: (i) a macroscopic display module for causing a macroscopic image of a tissue surface, captured by a macroscopic imager and stored in a computer memory, to be displayed on a visual display unit; (ii) a first selection module for receiving a selection of at least a part of the macroscopic image; (iii) a confocal display module to cause multiple confocal images captured, for each selected part of the macroscopic image, by a confocal imager at different depths in a corresponding part of tissue and stored in computer memory, to be displayed on the unit visual display; (iv) a second selection module for receiving a selection from among the plurality of confocal images of at least one image of a desired depth; and (v) an instruction module for instructing the confocal imager to capture, for each selected desired depth image, several additional images at different locations across a selected region of tissue and at a common depth with the desired depth image. BRIEF DESCRIPTION OF THE DRAWINGS
    [020] The objects, aspect and advantages mentioned above of the embodiments of the invention will become more evident from a reading of the description presented below, together with the attached drawings, in which:
    [021] Figure 1A is a schematic diagram of the system of an embodiment of the present invention having a confocal microscope with a confocal image former (or an image former head), a computer with a touch screen display unit and a macroscopic image former;
    [022] Figure 1B is a schematic diagram of a tissue fixation device, or a tissue ring, attachable to the macroscopic imager and confocal imager of Figure 1A;
    [023]Figure 1C is a schematic diagram illustrating the relationship of images captured in VivaStack® and VivaBlock® modes;
    [024] Figure 2 is a flowchart showing an operation in automatic mode of the system of Figure 1A, for acquiring one or more sets of images captured in VivaStack® and VivaBlock® modes;
    [025] Figure 3 is an exemplary user interface screen on the system display of Figure 1A, after capturing a macroscopic image by the macroscopic imager;
    [026] Figure 4 is an example user interface screen on the monitor of Figure 1A, showing icons superimposed on the macroscopic image, marking the locations for desired acquisition in VivaStack® mode;
    [027]Figures 5A - 5G are examples of a profile window in VivaStack® mode on the user interface screen in the Figure 1A display, allowing the user to select parameters, e.g. depth, number of sections or layers, and confocal imager (laser) power across the different layers, for acquisition in VivaStack® mode;
    [028] Figure 6 is an example user interface screen on the monitor of Figure 1A, showing the images of each group of images, after acquisition in VivaStack® mode, for user review and acceptance;
    [029]Figure 7 is the same example screen of Figure 4, in which the icons related to VivaStack® mode were graphically changed, to indicate the completion of acquisitions in VivaStack® mode;
    [030]Figures 8 and 9 are example user interface screens in the Figure 1A display, illustrating the images captured at different depths in VivaStack® mode, and the desired user selection depths for each VivaBlock® acquisition, where the Figure 8 does not have any desired depth selection, and Figure 9 shows an example of desired depths for four different sets of images, which will be acquired in VivaBlock® mode;
    [031] Figure 10 is an example user interface screen on the system display of Figure 1A, showing, with respect to confocal microscopes, a user-selected region superimposed for VivaBlock® acquisition, after the desired depths, for each captured image in VivaBlock® mode, they have been selected, as shown, for example, in Figure 9;
    [032] Figures 11 - 13 are example user interface screens on the system display of Figure 1A, for reviewing images captured in VivaBlock® mode, within the selected region of Figure 10, and in VivaStack® mode, by superimposed graphics in the macroscopic image;
    [033] Figure 14 is an example of the user interface screen on the system display of Figure 1A, during a manual mode of single image capture of the displayed images of the confocal imager of Figure 1A;
    [034] Figure 15 is an example of the user interface screen on the system display of Figure 1A, during manual video capture mode of the displayed images of the confocal imager of Figure 1A;
    [035]Figure 16 is an example of a single image of the confocal imager of Figure 1A, which can be captured during an acquisition in VivaStack® mode or in manual single image capture mode; and
    [036] Figure 17 is an example of an image taken in VivaBlock® mode, representing a composite image or a group map of confocal imagers, at one of the selected depths, as can be displayed during review in Figures 11 - 13. DETAILED DESCRIPTION
    [037] Referring to Figures 1A and 1B, the system 10 has a confocal microscope 12, as described in US patents 7,394,592 and 7,859,749 mentioned above, as well as international patent application PCT/US04/16255, which is incorporated in this specification by reference in its entirety. A suitable confocal microscope may be a VivaScope® 1500 microscope, manufactured by Lucid, Ind. of Rochester, NY. The confocal microscope 12 has a computer system 14, such as a personal computer (PC), coupled to a display 16 with a touch screen 54.
    [038] The computer system 14 receives the confocal images representing optically formed microscopic sectional images, such as cells or other tissue structures, from a confocal image former (an image former head) 18, which is mounted on a pivot pivot in a multi-axis arm mechanism 20, having front and rear arms 21 and 22. The confocal imager 18 has a nose tube 24, preferably made of clear plastic, which is secured to a conical hub 26 at the front of the confocal imager 18. The handles 28 are manually gripped and moved to allow multi-axis movement of the confocal imager. Electrical cables run along the arms 21 and 22 to provide power and allow communication between the confocal imager 18 and the computer system 14.
    [039] As described in US patents 7,394,592 and 7,859,749 and in international patent application PCTUS04/16255, three stepper motor drives are provided in the confocal imager 18, which drive a stage drive motor in the X direction , a stage drive motor in the Y direction and a motor that drives the objective lens of the confocal optical systems in the confocal imager in the Z direction, respectively, where X, Y and Z are orthogonal dimensions. In imaging tissue, the X and Y dimensions are substantially parallel to the surface of the tissue being imaged on or through it, and Z is substantially perpendicular to that surface to control the depth of the confocal imager. The motors can be activated by the user, changing the image formation position through the computerized system, sending signals to this or these motors.
    [040]The system 10 further has a macroscopic image former (or camera) 32, which is connected for data communication via a cable 31 to a port, such as a USB port, of the computer system 15, so that the computer system can receive macroscopic images from the imager 32. Conventional hardware and software in the imager 32 and computer system 14 may be provided to interface and communicate digital images. The macroscopic image provides a 10 x 10 mm macroscopic image for the computer system 14, which may be, for example, 1000 x 1000 pixels. This contrasts with, for example, the confocal imager's 4 x 4 mm imageable area, the confocal imager's imageable area may be of a slightly different size, such as , for example 8 x 8 mm or 20 x 20 mm. The macroscopic imager 32 may be a VivaCam® imager, available from Lucid, Inc. of Rochester, NY. Such a macroscopic imager, its use and operation in system 10 may be similar to those of the macroscopic imager described in U.S. Patent 7,864,996. Macroscopic image former 32 may also represent a conventional digital camera, which may interface with computer system 12 so as to receive digital images from the camera. As also described in US patent 7,864,996, a fabric fastening device, provided by a fabric support 48 on a fabric ring 30, having a window 52, may adhere by adhesion to the fabric, which fabric ring is supportable separately in macroscopic imager and confocal imager. Fabric ring 30 represents a fabric fastening device having a central opening 30a. The fabric ring 30 may be made of a metallic material with magnetic attraction to magnets so as to be releasably attachable by magnetic force to the fabric ring support 48. In use, a window of thin transparent material 52, formed, for example, of plastic or glass, is secured by a ring of adhesive (e.g., adhesive tape on both sides) to the underside of the fabric ring 30, the ring of adhesive being out of sight of the opening 30a. A tab 52b extends from the window 52 for use in later releasing the window 52 from the fabric ring 30, and for alignment as will be described later below. Another ring of adhesive (e.g., an adhesive tape on both sides) is similarly outside the field of vision of opening 30a, along front surface 52b for attachment to fabric. The fabric ring 30 is shown secured to the fabric in the example of Figures 3 and 4, whereby the fabric is visible through the opening of the fabric ring 30a and extends beyond the attached fabric ring 30.
    [041]System 10 has a graphical user interface (GUI), which represents a program or application in the memory of computer system 14. The GUI code may include an imaging module configured to: (i) cause a macroscopic image of a tissue surface, captured by the macroscopic imager, is displayed on a visual display unit; (ii) receiving a selection of at least a portion of the macroscopic image; (iii) for each selected part of the macroscopic image, causing multiple confocal images, captured by the confocal imager at different depths, on a corresponding part of the tissue, to be displayed on the visual display unit; (iv) receiving a selection from among the various confocal images of at least one image of a desired depth; and (v) for each selected desired depth image, instructing the confocal imager to capture multiple additional images at different locations, over a selected region, and at a common depth with the desired depth image.
    [042]The image forming module may include other modules, such as: (i) a macroscopic display module to cause a macroscopic image of a tissue surface, captured by a macroscopic imager and stored in memory, to be displayed in a visual display unit; (ii) a first selection module for receiving a selection of at least a part of the macroscopic image; (iii) a confocal display module to cause multiple confocal images captured, for each selected part of the macroscopic image, by a confocal imager at different depths, on a corresponding part of tissue, and stored in computer memory, to be displayed on the visual display unit; (iv) a second selection module for receiving a selection from among the plurality of confocal images of at least one image of a desired depth; and (v) an instruction module for instructing the confocal imager to capture, for each selected desired depth image, several additional images at different locations across a selected region of tissue and at a common depth with the desired depth image.
    [043] The user interface may be enabled, by the touch screen 54 of the monitor 16 and the computer system 14 coupled thereto, to allow a user to operate the system 10 from the touch screen 54. Other pointing mechanisms (e.g., mouse, trackball or the like) may be used in place of, or in addition to, a touch screen 54 to similarly allow the user to select to move, determine (click) and/or drag displayed graphic elements.
    [044]With reference to Figure 1C, in the discussion presented below, the terms VivaStack® and VivaBlock® are used, which are also described in U.S. Patent 7,864,996. A VivaStack® mode is a programmed operation of system 10 to automatically operate confocal imager 18 to capture and then store in computer memory a series 200 of confocal images, all at different Z-motor stage positions, but in the same location as the location stage of the X and Y confocal images. In other words, a confocal image set, obtained in VivaStack® mode, is a set or group of multiple confocal images at excessive tissue depths at an X-frame location, common Y. VivaStack® mode is a programmed operation of system 10 to automatically operate confocal imager 18 to capture and then store in computer memory a series 210 of confocal images, all at different locations of confocal image location stages X and Y, but at the same stage position as the Z engine, which are then joined together into a single composite confocal image. A user can review a macroscopic image 215 and then prepare an image series 200 in VivaStack® mode. The user can also review the 200 series of images taken in VivaStack® mode and select a desired depth 220 to review further. Afterwards, the user can request or review a series 120 of images, all taken at a common depth, ie the desired depth 220, in VivaBlock® mode. In other words, an image taken in VivaBlock® mode represents images of tissue sections, arranged to map a region of tissue to a common depth in the tissue. In summary, Figure 1C illustrates 210 layers, defined by image acquisition in VivaBlock® mode, with each column indicating a series 200 of images captured in VivaStack® mode.
    [045] In discussing the GUI of system 10, terms such as tap, select, tap, pinch, drag, and click, are used in the present specification to describe the operation of user finger tapping on screen 54 (or close enough to the screen to detect the finger), to provide a desired operation, as typical of a graphical user interface touch screen software hardware, operating on computer system 14 and monitor 16.
    [046]Referring to Figure 2, a flowchart of the operation of the system 10 of Figure 1A is shown, which will be discussed in conjunction with the user interface screen 54 of Figures 3 - 15. In step 56, the image former macroscopic 32 is located in tissue 70, such as a lesion 72 or other tissue structure of interest, to be confocally imaged, while the tissue ring 30 and a window 52 attached thereto are trapped in the imager 32, and fabric ring 30 and window 52 are typically secured to fabric, as described in US patent 7,864,996. Preferably, the user views the tissue 70 on the screen 54 as digital video images 75, so that the lesion 72 is shown as in the example of Figure 3, and then the user applies sufficient pressure to the macroscopic imager 32 in the direction of the fabric so that the adhesive on the lower surface of the window 52 facing the fabric is adherent and retains the fabric ring and window assembly in the fabric.
    [047]With the tissue ring 30 adhesion coupled to the tissue, a macroscopic image is then captured. When the Macroscopic Imager 32 is a VivaCam® camera sold by Lucid, Inc., the Imager 32 has a cable and trigger to start, stop or reset the camera. The user applies pressure to the housing 34 of the macroscopic imager 32, towards the tissue, which, in response, slides inward, with respect to the tissue ring 30, and through at least part of the nose tube 38, so that actuating a mechanical switch on the imager 32 to capture a high resolution macroscopic image 74 of the lesion 72 in window 75.
    [048]Optionally, a switch or button 41 on the macroscopic imager 32, or a touch screen button 54, can be used to capture one of the digital video images in window 75 with the macroscopic image 74. macroscopic imager 32 is then released from tissue ring 30, and into confocal imager 18, secured and aligned with tissue ring, for capturing confocal images, as described in US patent 7,864,996.
    [049]User interface screen 54 has a capture and mode selection control panel 69 on the upper right side of the screen, having graphic buttons 77a, 77b, 77c and 77d which the user can tap to select one of four system operation modes 10. Two automatic operation modes can be selected by buttons: VivaStack® 77a mode button and VivaBlock® 77b mode button. Two manual modes of operation can be selected by buttons: a 77c single image capture mode button and a 77d video capture mode button. The position of a cursor 77g along the horizontal ruler 77f indicates the current operating mode. A button 77e is also provided on the control panel 69, which changes its icon or graphic in each of the different modes, and that button 77e allows the user to control the operation or operations particular to the selected mode of operation of the system 10, as will be described in more detail below.
    [050]After capturing the macroscopic image 74, the user interface screen 54 of Figure 3 is shown with a grid graph 79 superimposed on the image 74 (step 57). The X, Y stages of the confocal imager 18 are represented as a grid 19 of all frame engine positions. In one embodiment, the grid 79 divides the image into, for example, '16 x 16 square blocks, where each block represents a frame position of the X, Y stage engine of the confocal imager. The number of frames in the grid may vary depending on the stage size, for example 8 x 8 mm = 16 x 16 frames, since 1 frame has a dimension of 0.5 mm. For example, this grid might be an 8 by 8 mm grid, as illustrated by the X and Y axes 76a and 76b, respectively. In another embodiment, the stage is further subdivided into selectable points for each possible X/Y coordinate, and the visible grid lines are hidden from view, allowing the X/Y engines to be at any possible location within the stage. Although system 10 defaults to VivaStack® mode, after capturing macro image 74 with button 77e, having a graphic or VivaStack® mode icon (see Figure 3), system 10 is waiting for user selection of an action on screen 54.
    [051]Of the four operating modes, VivaStack® mode will be discussed first. To start VivaStack® mode, the user lightly taps a graphic button 78, to enable "VivaStack® Layout" marking of desired locations of VivaStack® mode, at any desired location, for example: (i) along a or more different blocks framed in grid 79, with respect to tissue displayed in macroscopic image 74; or (ii) overlapping grid borders. Another embodiment may not visually display the grid, allowing positioning at any point within the X/Y stage coordinates. In response to being enabled, button 78 changes color, such as blue. The user then lightly taps one or more buttons on the grid 79 to mark the desired VivaStack® mode locations 80, as illustrated, for example, in Figure 4 (step 58). At each selected location, a graphic VivaStack® mode icon is then displayed in the tile indicative of your selection (step 58) with a pin graphic to push. To remove a particular selected VivaStack® mode location 80, the user again taps its location on the grid 79. To disable "VivaStack® Layout", the user again taps a graphic button 78, which reverts to its color original. In this way, the user can select the locations in which VivaStack® mode acquisitions are desired. For example, VivaStack® 80 mode locations can be selected close to the margins between the lesion and surrounding tissue, but any macroscopic tissue image area defined in grid 79 can be selected. If "VivaStack® Layout" is not enabled, the user can tap a tile or drag their finger across the tile to navigate (position the X/Y stage motors) the confocal imager 18 in X, Y directions.
    [052]After the desired VivaStack® mode locations 80 are marked, button 77e is then lightly tapped by the user, once system 10 is in VivaStack® mode, a start button is provided to initiate selection of the VivaStack® mode by a VivaStack® mode Profile window 81, which is overlaid on the screen, as shown in Figure 5A (step 59). The Profile window of VivaStack® 81 mode allows the user to vary the parameters by which each VivaStack® will be automatically captured by system 10 (step 60). In particular, the Profile window of VivaStack® 81 mode will automatically capture frames at fixed X, Y positions by incrementing (or decrementing) the Z depth. This allows the user to review, and, if desired, change the part to support of desired back in VivaStack® mode, the number of layers (or section) and the variation of laser power with depth (confocal imager 18 produces images using laser source illumination). Laser power increases in intensity with the depth of a tissue section being imaged, as indicated graphically by the increase in the width of the area or region 96, as the depth of image formation decreases along a scale of vertical depth 84. The horizontal lines 89 along the depth scale 85 represent each layer in the tissue in which a confocal image is to be captured with reference to its approximate depth along the scale 84.
    [053]The VivaStack® 81 Mode Profile window allows a user to select three parameters: depth, layer count, and laser power variation with depth. The depth of images collected in VivaStack® mode is provided by the user dragging a cursor 82 (e.g. a small blue box) to the desired depth, as indicated by the scale 84, as shown, for example, by the cursor 82 of Figure 5A being repositioned downstream in Figure 5B. The extent of depth 90 between top layer 89a and bottom layer 89b is shown with the number of layers in parentheses. For example, the desired depth of layer 89b in Figure 5A is 344.4 microns with 15 layers, and in Figure 5B it is 620.3 microns with 27 layers. The top horizontal line above line 89a represents the fabric surface at 0 micron. The starting depth of the topmost layer is equal in both cases to 22 microns, or the user can signal a relative zero point. This icon or button, when tapped lightly, allows the user to set the moment depth to "zero", and in doing so, adjust the starting depth of each set of images collected in VivaStack® mode. If the user does not press this button, to manually indicate the moment depth as zero, the system can automatically indicate the moment depth as relative zero and start all stacks from that location. Consequently, images collected in VivaStack® mode typically start at relative zero and the relative zero is user-defined, or, if not set by the user, the user is set to whatever depth the user is when initiating image acquisition in the VivaStack® mode. VivaStack®. The desired depth moves in a quantized fashion based on possible Z motor step sizes (eliminating guesswork and rounding errors). The laser power of the confocal imager in each of the layers 89, graphically illustrated by a shaded or darkened area 96, so that the power increment between each layer 89, indicated by the region 96 in increasing depth.
    [054]If the user wants to add or decrease the number of layers in a set of images, captured in VivaStack® mode, a layer count is selected by the 86 and 87 buttons, at which the user presses the ±86 and 87 buttons, on either side of the vertical cursor 88, to increase or decrease, respectively, the number of layers 89 that will be captured between layers 89a and 89b. For example, in Figure 5C, the number of layers is increased to 83, as graphically indicated by the additional horizontal lines between layers 89a and 89b. The depth span 90 can also vary, due to the size of the motor's step of motion at stage Z. This also varies the difference between each two successive layers 89 of its pattern, as shown in Figures 5A and 5B.
    [055]Laser power is selected by buttons 92 and 93, in which the user can press buttons ± 92 and 93 on horizontal cursor 94, to increase or decrease, respectively, the laser power level (power of confocal image), in terms of DAC (digital to analog conversion) counts, to increment between each layer 89, as indicated by varying the shape of area 96, as shown in Figure 5D, from that of Figure 5C. The user interface controls the laser over a range of 0 - 255 DAC counts, and these counts produce a resulting laser power in milliwatts. In addition, a user can simultaneously tap on or near two sides of area 96 to increase or decrease its width to provide an even greater laser power profile. For example, in Figure 5E, the user can select to "limit" the laser power on the desired layers 89, as indicated along part 98 of area 96, so that the laser power increases or decreases by the depth range. In this way, the user can select a desired laser power profile, when each set of images, collected in VivaStack® mode, is captured by the confocal imager 18.
    [056]Optionally, user can tap to alternate use of Auto Image Control (AIC) by activating AIC button 91, which is then indicated by area 96 appearing as shown in Figure 5F. The AIC automatically selects laser power during confocal imaging, which provides the best image by controlling the laser power, according to image pixel values within a desired range, to avoid under-imaging. or overexposed. For illustrative purposes, this is shown by a narrowing of region 96, but another graphical illustration of the AIC selection can be shown.
    [057]In Figures 5A - 5G, the preview image in window 75 of Figures 3 and 4 has been reduced in resolution and displayed in window 75a. Window 75 then shows the output confocal image displayed from the confocal imager 18. Previously, as in Figure 3, window 75a shows the output confocal image displayed from the confocal imager 18. Light tapping anywhere in the window 75a switches or skips the images in windows 75 and 75a on screen 54 as desired. For illustrative purposes, during VivaStack® profile selection, the confocal image of the confocal imager 18 is shown in window 75. In window 75a, one of the blocks of grid 79 has an overlapping color, such as blue, indicating the position of confocal imager 18's X, Y stage engines moment of the image in window 75. Button 73 shows a thumbnail of the last captured image - whether it's a macroscopic image, a single frame capture, a video or a collection of captured images in VivaBlock® or VivaStack® mode. By pressing button 73, the user gets a simple window.
    [058] When the VivaStack® mode profile selection is complete, the user lightly taps the Begin 100 button on the VivaStack® 81 mode profile window, to start the VivaStack® mode acquisition by the system 10. If the user presses the Instead of the Cancel button 101, window 81 is removed and screen 54 of Figure 4 is shown. User can also deselect VivaStack® mode profile and close window 81 can light tap anywhere outside profile window 81. User selected VivaStack® mode profile setting as shown in Figures 5A - 5E, can be saved in computer system memory 14 and retrieved for later replay if desired. The user does not need to make any parameter changes or acquisition adjustments for VivaStack® mode, but can merely tap the Begin 100 button after the VivaStack® 81 Mode Profile window is first opened.
    [059]In response to the user selecting the Begin 100 button, the system 10 operates the confocal imager 18, to acquire the images at different depths for each selected VivaStack® mode location 80, according to the VivaStack® mode profile (step 61). System 10 automatically positions the X,Y engines according to a location 80, according to their X,Y location on the grid 79, and in the Z engine steps according to the VivaStack® 89 mode profile layers, captures for each layer a sectional confocal image of the tissue through the window 52 of the tissue ring 30. The images are stored in the memory of the computer system 14.
    [060]Figure 6 represents screen 54 displayed succinctly, such as a predefined 2 - 3 second wait period (or other predefined period in computer system memory 10), between each set or group of images captured in VivaStack mode ® at each location 80, in order of acquisition from top to bottom depth and left to right. This allows the user to accept the images by flicking the icon or button 104, preview the images in a slideshow sequence in the window 75 by flicking the icon or button 105, or delete the images by clicking the icon or button 106, if not acceptable. If the user does nothing after the waiting period, images captured in VivaStack® mode at that location 80 are automatically accepted, at which point the system proceeds to acquire the next VivaStack® mode 80 brand location, if any. In Figure 6, the screen of Figure 4 is then in window 75a, and the location block marked VivaStack® 80, relative to the images shown in Figure 6, is a different color, such as blue, indicating that moment location of the motors X,Y Confocal Imager 18. If the user selects the Cancel button 105, the entire VivaStack® mode capture process ends for that location and any location not yet captured in VivaStack® mode. If the previous sets of images captured in VivaStack® mode are accepted, then these are stored and available for later playback. All or all accepted sets of images captured in VivaStack® mode are stored in computer system memory 10. If there is any requested set of images to be captured in VivaStack® mode not yet started/completed, then it continues to be shown by its associated icon 80, when the macroscopic image 74 is displayed. This allows the user to make adjustments, and then start over, with which system 10 will essentially harvest what was left on completion of all acquisitions in VivaStack® mode.
    [061]In step 62, the image sets acquired in VivaStack® mode are graphically indicated as being completed on screen 54 of Figure 7. Screen 54 of Figure 7 is the same as that of Figure 4, but instead of the location icons on the VivaStack® 80 mode on the screen, the VivaStack® 80a mode icons appear, which are graphically changed (eg removal of the squeeze pin graphic) to show completion. For any set of images, which will be acquired in VivaStack® mode, whose icon has not been completed, it will remain as icon 80, as if the user had canceled any acquisition in VivaStack® mode, during the review of Figure 6. User can optionally use Enable button 78, to remove or select another location from images captured in VivaStack® mode, as described above in conjunction with Figure 4, then steps 58 - 62 are repeated.
    [062]In step 63, the user can then review the images in any complete set of images 80a, captured in VivaStack® mode can lightly tap the corresponding location 80a on screen 54, as shown in Figure 7. When a complete set of images , captured in VivaStack® mode at location 80a, is tapped, system 10, in response, loads and displays from the memory of computer system 12 the captured images for that set of images, as shown, for example, on screen 54 of the Figure 8. Each confocal image 108 from this set of images selected in VivaStack® mode is displayed to capture, ie with increasing depth, from top to bottom and from left to right. For illustrative purposes, each image is illustrated by diagonal lines, but an example of a confocal image is shown in Figure 16. Arrow button 112, when lightly tapped, returns to screen 54 of Figure 7. If the icon or button 105 on screen 54 of Figures 8 and 9 is lightly tapped by the user, on-screen reproduction of images 108 in a slide sequence in window 75 is permitted. However, the user can remove the images captured in VivaStack® mode and which are displayed in Figure 8 by compressing the icon or button 106, which returns the screen to that of Figure 7, with the location 80a of the removed image set in VivaStack® mode also removed.
    [063] On screen 54 of Figure 8, during any review of images captured at location 80a in VivaStack® mode, the user uses these images to select the depth for capturing images in VivaBlock® mode. Each image 110 contains an icon 110, which, when clicked, acts to visually set a depth at which the user would like to proceed with image capture in VivaBlock® mode. Icon 110, when clicked by the user, changes graphically (e.g. color and grid illustration) to indicate selection from a set of images captured in VivaBlock® mode, at the depth of stage Z, at which the image was captured, as shown, for example, on the screen of Figure 9 by the selected icons 110a,b,c,d. One or more depths can be selected by selecting icons 110 from different images 108. To deselect, icon 110 can be clicked again. The act of having selected one or more layers on which to perform image acquisition in VivaBlock® mode automatically activates VivaBlock® mode, as shown in control panel 69 of Figure 9. If desired, the user can press the arrow button 112, which acts as a back button, to take the user back to the previous screen, allowing subsequent review of other sets of images.
    [064]After one or more selected depths desired for acquisition in VivaBlock® mode are marked by the selected icons 110, button 77e (now with a VivaBlock® graphic) can then be lightly tapped by the user to initiate selection for acquisition in VivaBlock® mode, as shown, for example, on screen 54 in Figure 10, having macroscopic image 74 with superimposed grid 79. The screen allows the user to select VivaBlock® mode using an adjustable rectangular region 114 (step 64) . The user clicks/pins two opposing corners within the macroscopic image 74, thereby defining a rectangular region 114 that the user wishes to acquire. In this way, the user can select the global X, Y region, in which each VivaBlock® mode acquisition will be conducted by the system 10, at the respective desired depth in Z of Figure 9. In the case of lesion 72 of the example of Figures 3 - 10, a 6 by 7 block area, including lesion 72, is selected. If the user wants to change the region 114, he can press once again outside the selected region 114, to clear the region, and then press again the opposite corners for the new selection. Optionally, the corner can be readjusted by dragging the corner with your finger. Unlike the user interface of US patent 7,864,996, in which the user can be limited to those millimeters, square map sizes around a center of region 114 can be selected to allow any size (in field of view increments) and any location by gross gross examination, in the confocal imager's field of view, as indicated by the extent of grid 79.
    [065]After region 114 is selected, user taps arrow button 115 on screen 54 to start acquisition in VivaBlock® mode by system 10, and a set of images is captured in VivaBlock® mode at each depth desired, previously selected from one or more review screens in VivaStack® mode (step 65). For each set of images in VivaBlock® mode, the system 10 automatically positions the Z motor of the confocal imager 18 at the desired depth for acquisition in VivaBlock® mode, and then the X, Y motors are scaled to capture a confocal image, according to each grid block 79 within region 114. If not using AIC mode, system 10 can also adjust laser power. The images are stored in the memory of the computer system 14, to provide a composite image, as shown, for example, in Figure 17. For each acquisition in VivaBlock® mode, the laser power is automatically adjusted equal to that used when the image, associated with the desired depth was captured in VivaStack® mode, unless AIC was used when the image was captured in VivaStack® mode, in which case VivaBlock® mode is specified in depth only.
    [066]Similar to the acquisition in VivaStack® mode, between each image automatically acquired in VivaBlock® mode, a screen 54, similar to the one in Figure 6, is shown with each set of images captured in VivaBlock® mode, before or after be formed into a composite image by the computer system 12 of the system 10, allowing the user to accept, reject or review the images, or the composite image, before proceeding to the next acquisition in VivaBlock® mode, at the next successive depth, if any. , in the same manner as described above in conjunction with Figure 6, for each acquisition in VivaStack® mode. If the user cancels the acquisition in VivaBlock® mode, the system returns to screen 54 in Figure 9, to allow the user to make some changes to one or more depth selections, and/or region selection 114, before starting the acquisition. VivaBlock® from any set of images in VivaBlock® mode not yet completed. This allows the user to make adjustments, if necessary, during the automated procurement process.
    [067]After the VivaBlock® mode images are captured, screen 54 in Figure 11 is displayed as a post-capture "session map", after the VivaStack® mode images and then the VivaBlock® mode images; have been automatically captured and stored in computer system memory 14 (step 66). In the example described above in Figures 3, 4 and 6 - 10 preview, images captured in VivaStack® mode are shown at 80a locations and in a dotted line encapsulating region 114, which was mapped with the VivaBlock® mode acquisition.
    [068]To review an acquisition in VivaStack® mode, its associated icon at location 80a is lightly tapped by the user, and then loaded from computer system memory 14, to display on screen 54, as shown, for example, in Figure 6 (step 67).
    [069]To review a VivaStack® mode acquisition in region 114, lightly touching screen 54 within mapped region 114 (different from icons 80a) displays in region 114 a composite image in VivaBlock® mode 126a, as shown, for example , in Figure 12 (step 69). By repeatedly clicking or tapping within the mapped region 114 (unlike icons 80a), the user can scroll through the composite images of each successive depth (with or with one of the images in that succession being the macroscopic image associated with region 114 ), if more than the set of images was captured in VivaBlock® mode, as shown in Figures 12 and 13 for VivaBlock® mode acquisitions 126a and 126b, respectively. By clicking or tapping outside region 114 in window 75, the composite map is hidden and macroscopic region 114 of image 74 is displayed again. In this way, the user can quickly tap in or out of the region to visually compare/toggle a confocal exam in VivaBlock® mode with the total macroscopic region 114 to which it refers. For illustrative purposes, the composite image or map of each VivaBlock® mode acquisition of Figures 12 and 13 is illustrated by diagonal lines, but an example of a composite image or map is shown in Figure 17. Confocal panel 69 is replaced with a thumbnail of the macroscopic image 74, and clicking on it brings up the other thumbnails, for review or selection of other captured images relating to the tissue being imaged. For illustrative purposes, the thumbnail image 74 is shown as a white box.
    [070]Optionally, the user can adjust a visual cursor (not shown) to adjust the transparency to blend the composite map from a VivaBlock® mode acquisition with region 114 of the macroscopic image 74, as described in US patent 7,864,996 , with respect to the different confocal images, to adjust the contribution of two different superimposed images. The graphic icon at the bottom right of region 114 of Figures 12 and 13, when compressed by the user, loads the acquisition in VivaBlock® mode in high resolution to search/zoom in a full screen mode.
    [071]Referring to the panel of Figure 3, showing the user interface screen 54, just after capturing the macroscopic image 74, the user can select a single image capture mode from the displayed images of the confocal imager 18 per light touch button 77c. An example of the screen 54, during manual single image capture mode, is shown in Figure 14, in which the live image feed from the confocal imager is displayed in the window 75, and the macroscopic image 74 is then displayed in the window. 75th Laser power is selected by buttons 116 and 117, where the user can press buttons ± 116 and 117 on horizontal cursor 118 to increase or decrease, respectively, the level of laser power (confocal imaging power) , or select button 120 for AIC control as described above. The user can also press anywhere on line 118 between the ± buttons to "jump" to a power. The vertical depth cursor works in the same way. Buttons 121 and 122 control the imaging depth (motor position in stage Z), where the user can press the ±121 and 122 buttons or vertical cursor 123 to increase or decrease the imaging depth in a location of the X, Y engines, as highlighted by a color, such as blue, in the macroscopic image 74 of the cell 54a. This location of the X,Y engines can be changed by the user by sliding their finger on window 74, in an oriented direction, or similarly using image 74, when tapped lightly on window 54. If the user wants to capture an image confocal being displayed, button 77e (following a Single Capture Mode graphic) is tapped by the user, whereupon system 10, which is in Single Capture Mode, has stored the image in window 74 in system memory computerized 14.
    [072]User can select video image capture mode from the displayed images of confocal imager 18 by light touch button 77d. In response, the system 10 provides a screen 54, as shown in Figure 15, which is the same as the screen 54 of Figure 14, but where the button 77e has a red circle icon, which allows you to start capturing video and then stop video capture of confocal images displayed in window 75. User cannot change modes while a block, stack, or video is being acquired. Acquisition must be complete (or stopped in the case of video) to change modes.
    [073]Referring to Figure 5G, to review all images during any of the above-described operating modes of system 10, a button 73 is provided on screen 54, which, when pressed by the user, causes thumbnail images of all the captured images. If the user then compresses one of these thumbnail images, it is then displayed at a high resolution for searching/zooming in full screen mode. The button graphic 73 is a thumbnail image of the last image capture by system 10. Also, on screen 54 is the start/stop confocal scan button 71, which when compressed starts or stops the operation of the confocal imager. by system 10.
    [074]At any point during imaging, by clicking or compressing any previously captured image or region within a VivaStack® mode or VivaBlock® mode, the confocal imager 18 automatically returns to position (in both power/ laser and motor wavelength) in which the particular frame was acquired, as shown in window 54a.
    [075] On screen 54 of Figure 3, the grid 79, which overlays the macroscopic image 74, models the X, Y stage of the confocal imager 18 and can mark the trace (such as with color or another indicator, such as depth) as well as the locations (grid block) in which stage X, Y is navigated along with image 74, and thereby retain information as for confocal imaging, which is done by the user. This functionality can also be used in the absence of a macroscopic image to navigate the X, Y stage of the confocal imager 18. In other words, the motors in the X/Y stage are controlled with finger swipes on the main window 75, such as left, right, up and down, and in all four diagonal directions. The user interface described in the present specification is therefore operative with or without a macroscopic imager 32 as part of the system 10.
    [076] The moment location of the X and Y motor stages of the confocal microscope can be highlighted by color in one of the grid boxes 79 arranged in the macroscopic image 74. Another color can be indicative of depth in addition to the moment depth (position of Z stage in terms of imaging depth), which is displayed on the screen. The user can reposition the X, Y engine stages on any block (or drag their finger along the grid) with respect to the imaged tissue at that location or locations. Previously seen X,Y blocks can continue to be highlighted by color, to indicate the region transformed into a stage-relative image or, if captured, a macroscopic image.
    [077]Other VivaScope® confocal microscopes, available from Lucid, Inc., such as the VivaScope® 2100 or VivaScope® 2500, can also be used in System 10 by adapting their imaging heads to the tissue holder 48 , so that they can be positioned to couple a tissue ring 30 when mounted to an ex vivo or patient in vivo tissue sample. Although the descriptive report describes confocal images for microscopic sections formed by optical imaging device using confocal microscopy, another type of image former can be used to provide microscopic sections formed by optical devices operating according to two-photon microscopy or a tomography of optical coherence. Also, other optical microscopes can also be adapted with this tissue support 48. Such as, for example, microscopes operating according to tomography or optical coherence interferometry, as described in Schmitt et al, "Optical characterization of disease tissues using low-coherence interferometry", Proc. Of SPIE, volume 1889 (1993), or a two-photon microscope, as described in U.S. Patent 5,034,613 to Denk et al., issued July 23, 1991 and incorporated by reference in its entirety herein.
    [078]Alternative embodiments are considered. For example, you can use System 10 to capture very closely spaced layers (ie in VivaBlock® mode) layered on top of each other in a Z direction, and then reconstruct those layers in 3D space. One can then provide a finger/gesture controlled 3D view of the lesion as a whole of a total macroscopic image through each of the confocal layers of the skin. Since each image in the reconstruction is related to all others within the coordinate space, interactive 3D modeling of the entire skin lesion by confocal cell resolution images can be provided instead of having a single screen or panel for each image. series of images taken in VivaBlock® or VivaStack® mode.
    [079] In some embodiments, the software can be designed to instruct the hardware to capture the full width and depth of a lesion without any user interaction. The set of images can subsequently be presented in 3D space, allowing a user to view the lesion, and optionally, directly scan a particular location.
    [080]From the description presented above, it will be apparent that improved user interface software and the systems and processes that use that user interface have been provided that provide an intuitive, user-friendly, touch-enabled imaging interface, and it is therefore especially suitable for clinicians. The foregoing description is to be regarded as illustrative and not in a limiting sense. While various aspects of the present invention have been described and illustrated in the present specification, alternative aspects may be promoted by those skilled in the art to achieve the same objectives. Accordingly, the appended claims are intended to cover all such alternatives, which fall within the true spirit and scope of the invention.
    权利要求:
    Claims (25)
    [0001]
    1. Method for tissue imaging, CHARACTERIZED in that it comprises: causing a macroscopic image of a tissue surface, captured by a macroscopic imager, to be displayed on a visual monitor; receiving a selection of at least a part of the image macroscopic; for each selected part of the macroscopic image, causing a plurality of confocal images, captured by a confocal imager at different depths in a corresponding part of the tissue, to be displayed on the visual monitor; receiving a selection from among the plurality of confocal images , at least one image of desired depth having a particular depth associated with itself; For each selected desired depth image, instruct the confocal imager to capture a plurality of additional images at different locations across a selected region of tissue and at a common depth with the particular depth associated with the selected desired depth image.
    [0002]
    2. Method, according to claim 1, CHARACTERIZED by the fact that the visual monitor comprises a touch screen.
    [0003]
    3. Method, according to claim 2, CHARACTERIZED in that receiving the selection of at least a part of the macroscopic image comprises identifying at least a touch in at least a part of the macroscopic image displayed on the touch screen.
    [0004]
    4. Method, according to claim 2, CHARACTERIZED in that receiving the selection of the at least one image of desired depth comprises identifying at least one touch in at least one confocal image displayed on the touch screen.
    [0005]
    5. Method, according to claim 2, CHARACTERIZED in that it further comprises identifying the selected region of the tissue by identifying at least one touch on the macroscopic image displayed on the touch screen.
    [0006]
    6. Method, according to claim 1, CHARACTERIZED by the fact that the selected region of the tissue corresponds to a user adjustable region, superimposed on the macroscopic image.
    [0007]
    7. Method, according to claim 1, CHARACTERIZED in that it further comprises causing a grid to be superimposed on the macroscopic image, the grid dividing the macroscopic image into blocks representing frame positions of a scaled engine for the confocal imager.
    [0008]
    8. Method, according to claim 1, CHARACTERIZED in that it further comprises, after receiving the selection of at least a part of the macroscopic image, making a graphic input for the confocal images to be captured to be displayed on the visual monitor.
    [0009]
    9. Method according to claim 8, CHARACTERIZED by the fact that the graphic input comprises user-selectable inputs to select a depth of a layer count for, and a laser power variation with depth for the confocal images to be captured .
    [0010]
    10. Method, according to claim 1, CHARACTERIZED by the fact that the plurality of additional images are captured individually at different locations on the selected region of the tissue.
    [0011]
    11. Method, according to claim 10, CHARACTERIZED in that it further comprises forming, for at least a common depth to a selected desired depth image, a composite image of the selected tissue region from the individually captured additional images.
    [0012]
    12. Method, according to claim 11, CHARACTERIZED in that it further comprises causing the composite image to be displayed on the visual monitor.
    [0013]
    13. Tissue imaging system, CHARACTERIZED by the fact that it comprises: computer memory to store images captured by macroscopic and confocal imagers, and store code that defines a set of instructions; and a processor for executing the instruction set, wherein the code comprises an imaging module configured to: (i) cause a macroscopic image of a tissue surface, captured by the macroscopic imager, to be displayed on a visual monitor;(ii) ) receiving a selection of at least a part of the macroscopic image; (iii) for each selected part of the macroscopic image, causing a plurality of confocal images, captured by the confocal imager at different depths in a corresponding part of the tissue, to be displayed on the visual monitor; (iv) receiving a selection from among the plurality of confocal images of at least one image of a desired depth having a particular depth associated with one's own; and (v) for each selected desired depth image, instructing the confocal imager to capture a plurality of additional images at different locations over a selected region of tissue and at a depth common to the particular depth associated with the selected desired depth image.
    [0014]
    14. System, according to claim 13, CHARACTERIZED by the fact that the visual monitor comprises a touch screen.
    [0015]
    15. System, according to claim 14, CHARACTERIZED by the fact that the imaging module, upon receiving the selection of at least a part of the macroscopic image, is configured to identify at least one touch in at least a part of the macroscopic image displayed on the touch screen.
    [0016]
    16. System, according to claim 14, CHARACTERIZED by the fact that the imaging module, upon receiving the selection of at least one image of the desired depth, is configured to identify at least one touch in at least one confocal image displayed in the touch screen.
    [0017]
    17. System, according to claim 14, CHARACTERIZED by the fact that the imaging module is further configured to identify the selected region of the tissue by identifying at least one touch on the macroscopic image displayed on the touch screen.
    [0018]
    18. System, according to claim 13, CHARACTERIZED by the fact that the selected region of the tissue corresponds to a user adjustable region superimposed on the macroscopic image.
    [0019]
    19. System, according to claim 13, CHARACTERIZED by the fact that the imaging module is further configured to cause a grid to be superimposed on the macroscopic image, the grid dividing the macroscopic image into blocks representing frame positions of an engine scaled to the confocal imager.
    [0020]
    20. System, according to claim 13, CHARACTERIZED by the fact that the imaging module is configured to, after receiving the selection of at least a part of the macroscopic image, make a graphic entry for the confocal images to be captured to be displayed on the visual monitor.
    [0021]
    21. System according to claim 20, CHARACTERIZED by the fact that the graphic input comprises user-selectable inputs to select a depth of, layer count for, and laser power variation with depth for the confocal images to be captured .
    [0022]
    22. System, according to claim 13, CHARACTERIZED by the fact that the plurality of additional images are captured individually at different locations on the selected region of the tissue.
    [0023]
    23. System, according to claim 22, CHARACTERIZED by the fact that the imaging module is further configured to form, for at least a common depth to a selected desired depth image, an image composed of the selected tissue region from of additional images captured individually.
    [0024]
    24. System, according to claim 23, CHARACTERIZED by the fact that the imaging module is further configured to make the composite image displayed on the visual monitor.
    [0025]
    25. Tissue imaging system, CHARACTERIZED in that it comprises: a macroscopic display module for causing a macroscopic image of a tissue surface, captured by a macroscopic imager and stored in a computer memory, to be displayed on a visual monitor; first selection module for receiving a selection of at least a part of the macroscopic image; a confocal display module for making a plurality of confocal images captured, for each selected part of the macroscopic image, by a confocal imager at different depths in a corresponding part of the tissue and stored in computer memory are displayed on the visual monitor; a second selection module for receiving a selection from among the plurality of confocal images of at least one image of a desired depth having a particular associated depth to itself; and an instruction module for instructing the confocal imager to capture, for each selected desired depth image, a plurality of additional images at different locations across a selected region of tissue and at a common depth with the particular depth associated with the selected desired depth image.
    类似技术:
    公开号 | 公开日 | 专利标题
    BR112015003464B1|2022-01-18|SYSTEMS AND PROCESSES FOR FORMING TISSUE IMAGES
    ES2751413T3|2020-03-31|Digital microscope
    JP6091866B2|2017-03-08|Measurement microscope apparatus, image generation method, measurement microscope apparatus operation program, and computer-readable recording medium
    JP6509820B2|2019-05-08|Adjustable digital microscope display
    US20070206275A1|2007-09-06|System for macroscopic and confocal imaging of tissue
    US10643396B2|2020-05-05|Methods and software for creating a 3D image from images of multiple histological sections and for mapping anatomical information from a reference atlas to a histological image
    US20140184778A1|2014-07-03|Image processing apparatus, control method for the same, image processing system, and program
    US20190304409A1|2019-10-03|Image processing apparatus and image processing method
    JP5015381B2|2012-08-29|Photomicroscope
    US10613313B2|2020-04-07|Microscopy system, microscopy method, and computer-readable recording medium
    US7865007B2|2011-01-04|Microscope system, observation method and observation program
    JP2005266718A|2005-09-29|Microscopic image photographing system
    CN104011531A|2014-08-27|Image processing device, image display system, image processing method, and image processing program
    US20150054855A1|2015-02-26|Image processing apparatus, image processing system, image processing method, and program
    US20210319881A1|2021-10-14|Medical system, medical apparatus, and medical method
    Banavar et al.2016|Image montaging for creating a virtual pathology slide: An innovative and economical tool to obtain a whole slide image
    JP5259853B2|2013-08-07|Microscope system
    BR112021004153A2|2021-05-25|digital imaging system and method
    KR20190022071A|2019-03-06|System of displaying medical image
    WO2020045536A1|2020-03-05|Medical system, medical apparatus, and medical method
    US11227355B2|2022-01-18|Information processing apparatus, method, and computer-readable medium
    US20180357738A1|2018-12-13|Information processing apparatus, method, and computer-readable medium
    同族专利:
    公开号 | 公开日
    EP2885670A1|2015-06-24|
    CN104704416A|2015-06-10|
    CN104704416B|2018-07-31|
    US9709791B2|2017-07-18|
    EP2885670B1|2021-01-27|
    ES2889917T3|2022-01-14|
    WO2014028314A1|2014-02-20|
    BR112015003464A2|2021-05-25|
    AU2013302966A1|2015-03-05|
    AU2013302966B2|2017-06-08|
    US20140049632A1|2014-02-20|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    US5034613A|1989-11-14|1991-07-23|Cornell Research Foundation, Inc.|Two-photon laser microscopy|
    US5880880A|1995-01-13|1999-03-09|The General Hospital Corp.|Three-dimensional scanning confocal laser microscope|
    US5788639A|1995-07-13|1998-08-04|Lucid Technologies, Inc.|Confocal imaging through thick dermal tissue|
    DE69840046D1|1997-03-19|2008-11-06|Lucid Inc|CELL SURGERY USING CONFOCAL MICROSCOPY|
    US7136144B2|2001-09-20|2006-11-14|Litel Instruments|Method and apparatus for self-referenced dynamic step and scan intra-field lens distortion|
    EP2278375B1|2003-05-20|2016-03-30|Lucid, Inc.|Confocal microscope for imaging of selected locations of the body of a patient|
    US7864996B2|2006-02-17|2011-01-04|Lucid, Inc.|System for macroscopic and confocal imaging of tissue|
    DE102006042242A1|2006-09-06|2008-03-27|Leica Microsystems Cms Gmbh|Method for examining an object with a microscope and a microscope|
    WO2010014712A1|2008-07-29|2010-02-04|Board Of Trustees Of Michigan State University|System and method for differentiating benign from malignant contrast-enhanced lesions|
    US20100150472A1|2008-12-15|2010-06-17|National Tsing Hua University |Method for composing confocal microscopy image with higher resolution|JP5739351B2|2009-03-11|2015-06-24|サクラ ファインテック ユー．エス．エー．， インコーポレイテッド|Automatic focusing method and automatic focusing device|
    US10139613B2|2010-08-20|2018-11-27|Sakura Finetek U.S.A., Inc.|Digital microscope and method of sensing an image of a tissue sample|
    US8433393B2|2011-07-07|2013-04-30|Carl Zeiss Meditec, Inc.|Inter-frame complex OCT data analysis techniques|
    US11021737B2|2011-12-22|2021-06-01|President And Fellows Of Harvard College|Compositions and methods for analyte detection|
    US9357916B2|2012-05-10|2016-06-07|Carl Zeiss Meditec, Inc.|Analysis and visualization of OCT angiography data|
    US9914967B2|2012-06-05|2018-03-13|President And Fellows Of Harvard College|Spatial sequencing of nucleic acids using DNA origami probes|
    US9677869B2|2012-12-05|2017-06-13|Perimeter Medical Imaging, Inc.|System and method for generating a wide-field OCT image of a portion of a sample|
    US10138509B2|2013-03-12|2018-11-27|President And Fellows Of Harvard College|Method for generating a three-dimensional nucleic acid containing matrix|
    EP2970497B1|2013-03-15|2017-10-25|Bayer HealthCare LLC|Anti-tfpi antibody variants with differential binding across ph range for improved pharmacokinetics|
    DE102013103971A1|2013-04-19|2014-11-06|Sensovation Ag|Method for generating an overall picture of an object composed of several partial images|
    DE102013008278B4|2013-05-15|2020-11-05|Nanofocus Ag|Method and device for 3-D measurement of the skin surface and skin layers close to the surface|
    US20150124079A1|2013-11-06|2015-05-07|Canon Kabushiki Kaisha|Image data forming apparatus and control method thereof|
    US10007102B2|2013-12-23|2018-06-26|Sakura Finetek U.S.A., Inc.|Microscope with slide clamping assembly|
    WO2015165989A2|2014-05-02|2015-11-05|Carl Zeiss Meditec, Inc.|Enhanced vessel characterization in optical coherence tomograogphy angiography|
    JP6843125B2|2015-09-24|2021-03-17|カール ツァイス メディテック インコーポレイテッドＣａｒｌ Ｚｅｉｓｓ Ｍｅｄｉｔｅｃ Ｉｎｃ．|High-sensitivity flow visualization method|
    JP6882282B2|2015-11-03|2021-06-02|プレジデント アンド フェローズ オブ ハーバード カレッジ|Methods and equipment for stereoscopic imaging of three-dimensional nucleic acid-containing matrices|
    EP3236311B1|2016-04-20|2019-08-07|Guilin Feiyu Technology Corporation Ltd.|Stable and controllable shooting apparatus|
    CN106094187A|2016-08-22|2016-11-09|中国科学院苏州生物医学工程技术研究所|Laser Scanning Confocal Microscope imaging system|
    WO2018045181A1|2016-08-31|2018-03-08|President And Fellows Of Harvard College|Methods of generating libraries of nucleic acid sequences for detection via fluorescent in situ sequencing|
    AU2017344741B2|2016-10-21|2019-06-20|First Frontier Pty Ltd|System and method for performing automated analysis of air samples|
    WO2019014767A1|2017-07-18|2019-01-24|Perimeter Medical Imaging, Inc.|Sample container for stabilizing and aligning excised biological tissue samples for ex vivo analysis|
    EP3836967A1|2018-07-30|2021-06-23|ReadCoor, LLC|Methods and systems for sample processing or analysis|
    CN109480906A|2018-12-28|2019-03-19|无锡祥生医疗科技股份有限公司|Ultrasonic transducer navigation system and supersonic imaging apparatus|
    法律状态:
    2018-11-21| B06F| Objections, documents and/or translations needed after an examination request according [chapter 6.6 patent gazette]|
    2020-06-09| B06U| Preliminary requirement: requests with searches performed by other patent offices: procedure suspended [chapter 6.21 patent gazette]|
    2021-11-23| B09A| Decision: intention to grant [chapter 9.1 patent gazette]|
    2022-01-18| B16A| Patent or certificate of addition of invention granted [chapter 16.1 patent gazette]|Free format text: PRAZO DE VALIDADE: 20 (VINTE) ANOS CONTADOS A PARTIR DE 09/08/2013, OBSERVADAS AS CONDICOES LEGAIS. |
    优先权:
    申请号 | 申请日 | 专利标题
    US201261683417P| true| 2012-08-15|2012-08-15|
    US61/683,417|2012-08-15|
    PCT/US2013/054276|WO2014028314A1|2012-08-15|2013-08-09|Systems and methods for imaging tissue|
    [返回顶部]